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ZZZ (54) Title: INDICATOR FOR A ROBOTIC MACHINE 




00 



(57) Abstract: A robotic machine such as a robotic vacuum cleaner (10) is controlled to carry out a task of cleaning a room. The 
^ machine has a plurality of sensors inchiding infrared sensors (26, 27), ultrasonic sensors (28, 29) and light sensors (17) through 
O which the machine can navigate its way around a room without bitting objects or walls in its path. The machine has an indicator 

light (35) which changes colour depending upon the state of interaction of the various sensors with the environment, indicatmg the 
O "mood" of the cleaner (10). The indicator (35) comprises three primary colour light sources which are combined within a reflective 
5^ frusto-conical chamber and a translucent lens dome in order to combine the primary colours into a single light as viewed by a user. 
^ This makes die machine more user-firiendly. 
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Indicator for a Robotic Machine 

This invention relates to a robotic machine and to a method of operating a robotic 
machine. It can be applied to a robotic floor cleaning device, such as a robotic vacuum 
5 cleaner, or some other robotic machine. 

It is known to provide a robotic vacuum cleaner programmed to clean the floor of a 
room. The programming may consist of feeding a detailed map of the room and training 
the cleaner to reciprocate to and fro from one side to the other side of the room. 
10 Alternatively, it may comprise leading the cleaner around the room in a training cycle so 
that the cleaner repeats the cycle from information stored in memory. International 
Patent Application No. PCT/GB99/04072 describes an autonomous vacuum cleaner 
which performs a spiral-like pattern to traverse the floor surface of a room. 

15 Some machines have warning lights to alert the user when a fault has occurred. For 
example, a vehicle engine management system will have a warning light which 
illuminates when a fault occurs. This may be a minor fault which does not have to be 
rectified urgently, or it may be a major fault requiring urgent attention. Until the vehicle 
fault is diagnosed by specialist equipment, or unless the vehicle breaks down, the user 

20 will be unaware of the state of health of his vehicle engine and its associated systems. 

Domestic appliances such as washing machines and dishwashers have animated dials 
which indicate what part of the washing cycle the machine has reached. It is also known 
to use a limited range of indicator lamps to represent a large number of fault conditions, 
25 with each fault condition being represented by a different combination of illuminated 
lights or a combination of flashing and steady illumination of the lamps. This can be 
very confusing for a user, and often requires a user to consult a user manual to interpret 
the state of the machine. 
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Computers have programs which, by making an unusual sound, warn the user that he is 
attempting an illegal or inappropriate entry on the keyboard, or that the computer cannot 
execute the requested function. A wide choice of such sounds is conmionly available. 

5 The Sony Corporation, on 11 May 1999, announced the launch of a four-legged 
entertainment robot called "AIBO". The head of the robot has two eyes, each eye 
having a red LED lamp and a green LED lamp spaced apart from one another. The red 
lamp is illuminated to express anger and the green lamp is illuminated to express 
happiness. The eyes flash red and green when the robot is confused. 

10 

Some users feel uneasy about using modem appliances. This is not helped by providing 
appliances that have a complicated and confusing array of controls and indicators. 

It is an object of the present invention to improve a user's understanding of the state of 
15 interaction occurring between a machine and its environment. 

A first aspect of the present invention provides a robotic machine having a plurality of 
sensors by means of which the robotic machine can interact with its environment, a 
controller for controlling the machine to carry out a task using the sensors, and an 

20 indicator light to indicate the state of interaction between the machine and the 
environment, wherein the controller is arranged to change the colour of the light 
according to the state of interaction and wherein the indicator light comprises two or 
more differently coloured light sources which are separately energisable, and means for 
combining the light output of the light sources to give the effect of a single coloured 

25 light. 

The light sources can be illuminated alone or in combination. 

By providing a single indicator which can take a range of colours, operation of the 
30 machine is made more user-friendly. Rather than looking at a confusing array of 
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indicators, the user simply looks at the colour of the single indicator for an indication of 
the machine's state or *mood\ When only one of the light sources is energised the 
indicator appears as that colour. For example, when the red source is energised, the 
indicator appears red. When multiple light sources are energised at the same time, the 
5 outputs of the sources are combined and the indicator has the colour of the combination. 
For example, when the red and green sources are illuminated, the indicator appears 
yellow/orange. Small variations in the state of the machine can be easily conveyed by 
shifting the colour of the indicator, e.g. from green to green-blue. 

10 Preferably the light sources comprise red, green and blue primary colour light sources as 
this combination of light sources is capable of generating the full range of visible 
colours. 

There can be multiple light sources of each colour. This increases the light output and, 
15 by interieaving the sources with other, differently-coloured sources, an improved 
blending effect is achieved. 

Each of the light sources can be provided as a separate device, a plurality of such 
devices being mounted on a support, or a single multi-source device can be provided. 
20 The multi-source device can include some form of diffused lens or this can be provided 
separately. 

While the embodiment describes the use of the indicator light on a robotic vacuum 
cleaner, the indicator can be used on other forms of robotic machine. 

25 

Another aspect of the present invention provides a method of operating a robotic 
machine. 

Embodiments of the invention will now be described with reference to the 
30 accompanying drawings, in which: 
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Figure 1 is a perspective view of a robotic cleaning device according to an embodiment 
of the invention; 

5 Figure 2 is a schematic diagram of a power management and navigation system of the 
device of Figure 1; 

Figures 3A and 3B schematically show two forms of indicator light used in the cleaning 
device of Figure 1; 

10 

Figure 4 shows the well-known colour triangle; 

Figure 5 shows the functional blocks which control the indicator light; 

15 Figure 6 schematically shows the software tasks performed by the controller of the 
cleaning device; and 

Figures 7A - 7D show a range of states for the cleaner and the corresponding condition 
of the indicator light. 

20 

Referring to Figure 1 of the drawings, there is shown a robotic floor cleaning device in 
the form of a vacuum cleaner, comprising a main body 10, two drive wheels 11, a brush 
bar housing 12, two rechargeable battery packs 13, a cyclonic separator 15, light 
detectors 17, various sensors 26 to 32 and a user interface 16 which includes switches 
25 14. The cyclonic separator is described more fully in EP-A-0 042 723. Other forms of 
separator such as a bag can be used in place of the cyclonic separator 15. 

Mounted on the upper face of the cleaner 10 is an indicator light 35 which shows by its 
colour the state of interaction between the machine's sensors and its environment and 
30 thus indicates the "mood" of the machine. Conveniently, the indicator light 35 is 
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mounted concentrically within the light detectors 17. The light detector 17 detects light 
received from a plurality of compass points around the vacuum cleaner, as described in 
our pending International Patent Application No PCT/GB 99/04092. 

5 There are various ways in which the cleaner can be programmed. In a preferred method, 
the cleaner performs a spiral-like coverage of a room. The cleaner is programmed so 
that it firstly completes a traverse around the edge of a room, or around a feature or 
object in the room, and then moves inwards, or outwards, by approximately the width of 
the cleaner, and then completes a second traverse alongside the first. It then again 

10 moves in or out by a width for a third traverse alongside the second, and so on until the 
room has been cleaned. It thus follows a generally spiral-like path, except for obstacles 
such as furniture which lie in its path, and which it avoids by using its sensors to detect 
them and drive around them. 

15 Referring now to Figure 2 of the drawings, there are shown the rechargeable battery 
packs 13, a battery and motor management system 18, a motor 19 for driving a suction 
fan. motors 20 and 21 for driving the left and right hand wheels 11, a motor 22 for 
driving the brush bar, processing circuitry 23 of the navigation and control system, a 
user interface board 26 and the light detector 17. The processing circuitry 23 includes a 

20 microprocessor, a field programmable gate array (FPGA) and control software 45. The 
indicator light 35 is connected to the user interface board 25 and is controlled by signals 
received from the processing circuitry 23 over communications link 40. 

The navigation system of the cleaner includes the various sensors 26 to 32 as shown in 
25 Figure 2. There are four main ultrasonic transmitter/receiver pairs 29 which face 
forwards, rearwards and to opposite sides of the robotic cleaner. The signals received 
from these receivers 29 not only provide information representative of distance from a 
feature of the room or from an object in the room, but the amplitude and width of the 
received signals vary according to the type of material sensed. Threshold sensors 30 
30 detect the presence of a portable threshold locator (not shown) placed, for example, at 
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the entrance to a room or at the top of a staircase, and one or more pyroelectric or 
passive infrared (PIR) detectors 31 are provided for detecting animals and fires. It will 
be appreciated that the type of sensor (ultrasonic, infrared) is not important to the 
invention and that other types of sensor can be used in addition to these, or instead of 
5 these. 

The mood indicator light 35 is controlled by the processor circuitry 23 through the user 
interface board 26. The processor circuitry 23 determines, from the sensors 26 to 32 and 
the motor current sensors, the interaction of the cleaner with its surroundings. 

10 

Referring now to Figure 3A, in the preferred embodiment the mood indicator light 35 
comprises six LED light sources grouped together under a dome 35A which can be 
fomied of a translucent or transparent material, such as a plastics material. The LEDs 
emit light in primary colours - red (R), blue (B) and green (G). It is preferred that a pair 

15 of each LEDs are provided. Each colour pair is energized separately from the other 
pairs. The LEDs are housed beneath a frusto-conical chamber 35A having a base 35C 
supporting the LEDs, and a light diffuser 35B supported on top of a frusto-conical wall 
35D. The light diffuser 35B can be achieved by treating the upper surface of the 
chamber 35A to render it translucent, or by a separate diffuse part. The light diffuser 

20 35B operates in a way which combines the light output of the LEDs so that the user sees 
the combined effect of the LEDs rather than their individual outputs. The inside wall of 
the frusto-conical wall 35D is reflective, which can be achieved by silvering the tapering 
wall 35D. 

25 In the alternative arrangement of Figure 3B, mood indicator light 50 comprises a single 
device 50C which includes multiple light sources (red, green and blue.) A diffused lens 
may be provided as part of the device 50C for combining the outputs of the individual 
light sources. As such devices 50C are usually quite compact, it is preferred to mount 
the device mounted beneath an outwardly tapering chamber 50A which includes a light 

30 diffuser 50B on its upper face. 
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Referring to the colour triangle in Figure 4, the mood indicator light has the capability 
of producing any visible colour by energizing the R, G and B LED light sources by the 
correct amount, according to the colour triangle. 

5 

It would be possible to have a simpler mood indicator light with, for example, just two 
light sources. A more limited range of colours would be obtainable in the combined 
output. Also the light sources need not be primary colours but then the range of colours 
obtainable from the combined output would be further restricted. 

10 

Referring to Figure 5 of the drawings, the processor circuitry 23 detects the sensor 
activity from sensors 27 to 32 and controls the vacuum cleaner and guides it around the 
room. Also the communications link between circuitry 23 and the user interface 25 
provides information on the amount of sensor activity. The energy provided to the red, 
15 green and blue light emitting diodes R,G,B of the mood light 35 are controlled by pulse 
width modulation PWM to achieve the colour corresponding to the amalgamated sensor 
activity as determined by processing circuitry 23. 

In this embodiment the activity of the vacuum cleaner is broken down in the software 
20 into individual tasks, based on what is known as a Subsumption Architecture. Figure 6 
shows this schematically. 

There are several independent tasks or activities of the cleaner in the software, two 
examples appropriate to this embodiment being Wander and Wall Follow. The various 
25 sensors 26 to 32 provide sensor values via a server mechanism to the software and each 
software task interrogates the server to establish the sensor values. 

At the lowest level the sensor software drivers handle low level interaction with the 
hardware to obtain the information provided by the sensors 26 to 32. There is a single 
30 driver which can communicate with all the hardware sensors of a single type and two 
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examples are shown in Figure 6, namely all the ultrasonic sensors are handled by driver 
US and all the infrared sensors are handled by driver IR. 

The Sensor Server 62 handles requests from the Tasks and obtains data from the drivers 
5 and presents it back in a more appropriate form. Each Task makes a decision as to what 
it believes is the appropriate behaviour. 

The Mood light Server receives the R. G, B suggestions from the Tasks and a single 
representative R, G, B value is calculated and used as the indication on the mood light 
10 35. 

The Mood Light Server has knowledge about the relative importance of the Task 
suggestions and can determine the appropriate R, G, B value based on this knowledge. 

15 Looking first at the Wall Follow Task, in this embodiment the Task will expect, in order 
to establish Wall Follow behaviour, to find a wall on the left hand side of the cleaner, 
nothing in front and nothing to the right. If the Wall Follow Task sees this set of sensor 
conditions then it decides that it is competent to act in controlling the cleaner. As long 
as those sensor conditions prevail then it will continue to act, and appropriate motor 

20 drive commands are sent to the left and right hand drive motors 20 and 21 (Figure 2) via 
the motor drive interface MD. At the same time, the Wall Follow Task sends a signal to 
the Mood Light Server. The Mood Light Server sends signals to the mood indicator 
light 35 via the conrununications link and the user interface 26 to energize the mood 
light. Thus a data packet carries commands and data representing the appropriate power 

25 level for each light source R. G and B. The commands are interpreted by the FPGA in 
the user interface 25 to turn on the source (e.g. R = 0, B = 250, G = 0) through the pulse 
width modulator PWM and the green source connection g (Figure 3). It should be 
pointed out that Figure 5 is very schematic: for example, each source would normally 
have its own pulse width modulator and the block PWM represents this, as would be 

30 understood by those skilled in the art. 
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The Task named Wander in this embodiment will expect, in order to establish Wander 
behaviour, to find no wall on either side or in the front. In this embodiment this means 
the cleaner cannot locate a reference point by means of which it can orientate itself. If 
5 the Wander Task finds this set of sensor conditions then it decides it is competent to act 
in controlling the cleaner and will continue to do so as long as these conditions prevail. 
Motor drive commands are sent to the left and right hand drive motors 20, 21 (Figure 2) 
via the motor drive interface MD. 

10 At the same time the Wander Task sends a "yellow" signal to the Mood Light Server. 
The Mood Light Server signals to the mood light 35 via the communications link to 
energize the LEDs, based on its determination of all inputs, to provide a yellow light ie 
substantially equal power to source R and source G and no power to source B, i.e. R = 
50,G = 50 andB = Q. 

15 

Similarly, other software tasks which control the motion of the vacuum cleaner are able 
to provide R, G and B values to the Mood Light Server thus influencing the state of the 
mood indicator light. 

20 Each software task is continually signalling so long as it decides it is competent and the 
decision network passes the preferred signal, or the only signal, on to the motor driver 
interface MD. 

In addition to the software tasks, there is a monitor system Monitor which also reads the 
25 sensor signals. The monitor system will check that when drive current is applied to one 
or both drive motors (as sensed by the current sensors) an appropriate change of signal 
occurs at the distance sensors. For example, if the drive motors are attempting to drive 
the cleaner forward then it will expect to see the distance from a wall in front of the 
cleaner decrease using say the infrared sensors for near distance, or the ultrasonic 
30 sensors for far distance. 
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Then again, if the drive motors are trying to rotate the cleaner, it will expect to see a 
change in the side wall sensors as the side wall should disappear from range. 

5 The Monitor Task will send a signal to the Mood Light Server if its check indicates the 
distance sensor signals are not changing despite the drive motors being energized, i.e. 
the cleaner is stuck. It will also power down the cleaner after a predetermined period if 
the cleaner does not move or if some other malfunction is detected, and it will signal a 
visible pulsed mode to the red light source R. 

10 

In this embodiment the mood light can have: 

1) a blue colour when the cleaner is "happy" and, for example, travelling along a 
wall in a straight line which requires minimal sensor activity (Figure 7A); 

2) a green-blue colour which will be produced when turning a comer or 
15 navigating around an obstacle, representing a more demanding scenario and hence 

increased sensor activity including changes in drive current to the motors (Figure 7B); 

3) a yellow-green (i.e. more yellow than green) colour if the heat sensors sense a 
warm object ahead in the path of the cleaner; 

4) a red colour if the heat sensor senses a hot body ahead, for example a fire, or 
20 if there is very significant sensor activity when the cleaner is sensing several objects and 

there are rapid changes in drive motor currents which may be regarded as a very 
demanding scenario (Figure 7C); 

5) a flashing red light if the sensor activity is very high such as "abuse", or 
jammed driving wheels or brush bar or the cleaner is stuck in one place and unable to 

25 extricate itself (Figure 7D). 

It is to be understood that these examples of colour and colour changes can be modified 
within the scope of the present invention and the particular colours chosen to indicate 
particular scenarios and interaction with the environment are examples only and not 
30 specifically limiting. 
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In the extreme case when for example a brush bar becomes jammed or a drive wheel 
becomes jammed, then the associated drive motor will draw a larger current during 
attempts to drive the brush bar or the drive wheel. The current sensors detecting these 
5 higher motor currents and rapid changing currents are shown in Figure 6 schematically. 

When the cleaner is searching for a wall using its IR sensors and also during a self-test 
mode, the green LEDs will be energized. 

10 When the cleaner is turning a comer using its ultrasonic sensors, both blue and green 
LEDs will be energized to create an overall green-blue colour. 

Mood indicator light 35 only operates in auto-run mode i.e. during automatic operation. 
The cleaner can be used in other modes not further described here but for example when 
15 using a hose to clean comers or perimeters which the cleaner on automatic run would 
not be able to reach. The mood indicator light 35 does not operate in these modes. 

As described the colour of the mood indicator light 35 indicates to the user the state of 
the interaction between the robot and its environment. If the machine becomes blocked 
20 in so that it cannot move, or if it has come to a stair edge and finds that it cannot safely 
back away from the edge, then the mood light will after some seconds flash red on and 
off. This represents one extreme "mood" in which the machine is very "unhappy". 
After a short period of time, e.g. 10 minutes, in this mood the machine will shut down 
and meanwhile the flashing red light invites user intervention. 

25 

At the other extreme when the machine is running according to the program the mood 
light will show a continuous green colour. As the machine proceeds in cleaning the 
floor it will approach a wall or object to be navigated and the sensors will detect this. 
The cleaner will turn to the right or to the left in order to continue cleaning and during 
30 this activity the increased sensor activity will change the mood light to a green-yellow 
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colour to indicate the change in activity. When the turn is complete the mood light will 
revert to green colour as previously. 

If the cleaner enters a blind alley say between a sofa and a wall with a second wall 
5 closing the end, having been following the first wall the cleaner mood light will show 
green initially. As the cleaner turns at the end of the alley firstly through 90"^ to the right 
as it detects the second wall the mood light will change to green-yellow and then 
through another 90*" to the right as it detects the sofa the mood light will continue green- 
yellow but revert to blue-green as it travels back up the alley. If in the meantime the 

10 entrance to the alley has become blocked so the cleaner has no way out then within a 
few seconds the mood light will change from green to green-yellow as it attempts to 
manoeuvre with increased sensor activity, and finally it will turn red to indicate that it is 
not "happy". Within another few seconds if the block to the alley has not been removed 
the cleaner will shut down its cleaning action and the mood light will change from 

15 continuous red to flashing red. 

The embodiment described depends upon a source of light by which to navigate using 
the light sensors 17. If for example the light is suddenly extinguished, the cleaner will 
become highly confused and will go into its red light mode followed by red flashing 
20 light mode. This might happen if for example a cushion fell on top of the cleaner or a 
child abused the cleaner by sitting upon it. 

If the cleaner has shut down prematurely before completing the cleaning of the room, 
when the cleaner is next attended by the user it will not have finished cleaning and will 
25 not have returned to its starting position according to the program. Accordingly the 
machine can either be restarted and the path rendered navigable by the user, and the 
cleaner will continue and complete the area as yet not cleaned during the previous 
attempt. Alternatively, the cleaner can be repositioned at its original starting point, the 
path having been rendered navigable by the user, and the whole room cleaned again. 

30 
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Referring back to the colour triangle in Figure 4, the mood light will show green by 
energizing the green LED. It will show green-yellow by energizing green and, to a 
lesser extent, the red LED. Any colour can be created as it well known in the art by 
addition of the three primary colours of the LEDs as shown in the colour triangle. 
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Claims 

1. A robotic machine having a plurality of sensors by means of which the robotic 
machine can interact with its environment, a controller for controlling the machine to 

5 carry out a task using the sensors, and an indicator light to indicate the state of 
interaction between the machine and the environment, wherein the controller is arranged 
to change the colour of the light according to the stale of interaction and wherein the 
indicator light comprises two or more differently coloured light sources which are 
separately energisable, and means for combining the light output of the light sources to 

10 give the effect of a single coloured light. 

2. A machine according to claim 1 wherein the light sources are energisable at the 
same time. 

15 3. A machine according to claim 2 wherein the light sources arc red, green and 
blue. 

4. A machine according to any one of the preceding claims wherein there are a 
plurality of light sources of each colour. 

20 

5. A machine according to any one of the preceding claims wherein the power of 
each light source is separately controllable. 

6. A machine according to claim 5 wherein the power of each light is controllable 
25 by a pulse width modulator in response to a control signal indicative of the required 

power. 

7. A machine according to any one of the preceding claims wherein the combining 
means is a light diffuser. 

30 
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8. A machine according to claim 7 wherein the hghl diffuser is a translucent lens. 

9. A machine according to claim 8 wherein the light sources are grouped beneath a 
tapering chamber. 

5 

10. A machine according to claim 9 wherein the chamber tapers inwardly from the 
light sources. 

11. A machine according to claim 9 or 10 wherein the chamber has a reflective 
10 coating. 

12. A machine according to any one of the preceding claims, wherein a software 
subsumption architecture is used to input its state to a processing mechanism which 
determines the energization of the light sources. 

15 

13. A machine according to any one of the preceding claims in the form of a robotic 
floor cleaning device. 

14. A method of operating a robotic machine comprising providing a controller, a 
20 plurality of sensors by means of which the robotic machine can interact with its 

environment, and an indicator light comprising two or more differently coloured light 
sources which are separately energisable and means for combining the light output of 
the light sources to give the effect of a single coloured light, using the controller to 
control the machine to carry out a task using the sensors, using the indicator to indicate 
25 the state of interaction between the machine and the environment and changing the 
colour of the indicator light according to the state of interaction between the machine 
and the environment. 

15. A machine or a method substantially as described herein with reference to the 
30 accompanying drawings. 
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